Imaging apparatus and image communication method

ABSTRACT

An imaging apparatus includes a communication unit, a display unit, a selecting unit, an imaging unit, and a control unit. The communication unit acquires image data of a connection partner from an external apparatus of the imaging apparatus. The display unit displays an image in accordance with the acquired image data of the connection partner. The selecting unit selects, as a connection side, one of sides of the image displayed on the display unit. The imaging unit images a subject to acquire image data to be connected to the image data of the connection partner after the connection side is selected by the selecting unit. The control unit records the image data acquired by the imaging unit in a recording unit together with information indicating the position of the connection side.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based upon and claims the benefit of priority fromthe prior Japanese Patent Application No. 2012-256085, filed Nov. 22,2012, the entire contents of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an imaging apparatus and an imagecommunication method.

2. Description of the Related Art

Heretofore, various suggestions have been made regarding imagingapparatuses having a function to collect and edit photographic images.For example, Jpn. Pat. Appln. KOKAI Publication No. 3-93364 suggestsediting, in accordance with a set time schedule, photographic datacorresponding to each model image obtained by photographing athree-dimensional model from a given point of view and with a desiredangle of field.

In connection with, for example, digital cameras, there has been known atechnique for creating an image called a composite picture in whichphotographic images are combined to express a particular theme. Forexample, Jpn. Pat. Appln. KOKAI Publication No. 2009-237703 provides atechnique that enables such a composite picture to be easily created.Images are grouped by an extraction condition input by a user, andsamples of the grouped images are displayed so that images used for thecomposite picture can be easily searched for.

BRIEF SUMMARY OF THE INVENTION

An imaging apparatus according to a first aspect of the inventioncomprises: a communication unit configured to acquire image data of aconnection partner from an external apparatus of the imaging apparatus;a display unit configured to display an image in accordance with theacquired image data of the connection partner; a selecting unitconfigured to select, as a connection side, one of sides of the imagedisplayed on the display unit; an imaging unit configured to image asubject to acquire image data to be connected to the image data of theconnection partner after the connection side is selected by theselecting unit; and a control unit configured to record the image dataacquired by the imaging unit in a recording unit together withinformation indicating the position of the connection side.

An image communication method according to a second aspect of theinvention comprises: acquiring image data of a connection partner froman external apparatus of an imaging apparatus; displaying an image on adisplay unit in accordance with the acquired image data of theconnection partner; selecting one of sides of the image displayed on thedisplay unit, as a connection side, by a selecting unit; imaging asubject after the connection side is selected, to acquire image data tobe connected to the image data of the connection partner.

Advantages of the invention will be set forth in the description whichfollows, and in part will be obvious from the description, or may belearned by practice of the invention. The advantages of the inventionmay be realized and obtained by means of the instrumentalities andcombinations particularly pointed out hereinafter.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING

The accompanying drawings, which are incorporated in and constitute apart of the specification, illustrate embodiments of the invention, andtogether with the general description given above and the detaileddescription of the embodiments given below, serve to explain theprinciples of the invention.

FIG. 1 is a block diagram showing the configuration of an imagecommunication system according to one embodiment of the presentinvention;

FIG. 2A is the first portion of a flowchart showing the operation of animaging apparatus;

FIG. 2B is the second portion of the flowchart showing the operation ofthe imaging apparatus;

FIG. 2C is the third portion of the flowchart showing the operation ofthe imaging apparatus;

FIG. 3 shows an example of a top screen of a site managed by an SNSserver;

FIG. 4 is a diagram showing an example of a screen displayed on adisplay unit after the selection of an image;

FIG. 5 is a diagram showing an example of a connection side selectionguide screen;

FIG. 6 is a diagram showing an example of a divided through-imagedisplay;

FIG. 7 is a diagram showing an example of a composite pictureconfirmation display;

FIG. 8 is a diagram showing an example of a normal through-imagedisplay;

FIG. 9 is a diagram showing an example of image reproduction;

FIG. 10 is a flowchart showing image sharing processing;

FIG. 11 is a diagram showing an example of a communication connectiondestination selection screen;

FIG. 12 is a diagram showing an example of an image joint permissionselection screen;

FIG. 13 is a flowchart showing the operation of the SNS server; and

FIG. 14A, FIG. 14B, FIG. 14C, and FIG. 14D are diagrams illustratingimage joint processing by another imaging apparatus.

DETAILED DESCRIPTION OF THE INVENTION

Hereinafter, an embodiment of the present invention will be describedwith reference to the drawings.

FIG. 1 is a block diagram showing the configuration of an imagecommunication system according to one embodiment of the presentinvention. The image communication system shown in FIG. 1 includesimaging apparatuses 100 a, 100 b, 100 c, and 100 d, and an SNS server200. The imaging apparatuses 100 a, 100 b, 100 c, and 100 d areconnected to the SNS server 200 to be able to communicate via a network300. The imaging apparatuses 100 a, 100 b, 100 c, and 100 d are alsoconnected to be able to communicate with one another.

For simplicity of explanation, the configuration of the imagingapparatus 100 a is described below on the assumption that the imagingapparatuses 100 a to 100 d have the same configuration. In actuality,however, the imaging apparatuses 100 a to 100 d do not need to haveexactly the same configuration.

The imaging apparatus 100 a is, for example, a digital camera or asmartphone, and includes an imaging unit 102, a display unit 104, arecording unit 106, a clock unit 108, an operation unit 110, a touchpanel 112, a communication unit 114, and a control unit 116.

The imaging unit 102 includes a photography lens 102 a and an imagepickup device 102 b. The photography lens 102 a generates an opticalimage of an unshown subject, and focuses the generated optical image onthe image pickup device 102 b. The driving of the photography lens 102 ais controlled by the control unit 116 having a function as an imagingcontrol unit 116 a. Here, the photography lens 102 a may be aninterchangeable lens configured to be removable from the body of theimaging apparatus 100 a, or may be configured to be integral with theimaging apparatus 100 a. The image pickup device 102 b has alight-receiving surface in which photoelectric conversion elements aspixels are two-dimensionally arranged. Each of the pixels converts theimage of the subject focused via the photography lens 102 a to anelectric signal (image data).

The display unit 104 displays various images such as an image based onimage data processed by an image processing unit 116 b of the controlunit 116. The display unit 104 comprises, for example, a liquid crystaldisplay.

The recording unit 106 records an image file generated from the imagedata processed by the image processing unit 116 b of the control unit116. The recording unit 106 is, for example, a flash memory incorporatedin the imaging apparatus 100 a. The recording unit 106 may be configuredto be removable from the imaging apparatus 100 a.

The clock unit 108 clocks various dates such as a photography date. Theclock unit 108 may be incorporated in the control unit 116.

The operation unit 110 includes operation components for variousoperations of the imaging apparatus 100 a performed by the user. Theoperation components include, for example, a release button, a movingimage button, and a power switch. The release button is an operationcomponent used by the user to instruct the imaging apparatus 100 a tostart still image photography. The moving image button is an operationcomponent used by the user to instruct the imaging apparatus 100 a tostart and end moving image photography. The power switch is an operationcomponent used by the user to instruct the imaging apparatus 100 a toturn on or off power.

The touch panel 112 is integrally formed on a display screen of thedisplay unit 104, and supplies the control unit 116 with informationregarding a touch position of, for example, a finger of the user on thedisplay screen. The touch panel 112 also functions as a selecting unitused by the user to select a connection side in a connection sideselection guide screen described later.

The communication unit 114 is, for example, a wireless LAN interface,and serves as an intermediary when the imaging apparatus 100 acommunicates with the network (e.g., the Internet) 300 or the otherimaging apparatuses 100 b, 100 c, and 100 d.

The control unit 116 controls the operation of each block of the imagingapparatus 100 a in accordance with the operation of, for example, theoperation unit 110 or the touch panel 112. The control unit 116 has theimaging control unit 116 a, and controls lens driving (e.g., focusdriving and zoom driving) of the photography lens 102 a of the imagingunit 102. The control unit 116 also has the image processing unit 116 b,and subjects the image data to image processing. The image processing bythe image processing unit 116 b includes various kinds of processingsuch as white balance correction processing and gamma correctionprocessing necessary when an image corresponding to the image data isdisplayed on the display unit 104 or recorded in the recording unit 106,and also includes, for example, compression processing and decompressionprocessing. The image processing unit 116 b also performs processing tocombine multiple image data. The control unit 116 also has a metadatachanging unit 116 c, and changes metadata recorded in a headerinformation portion of the image file. In the present embodiment,position information of a connection side, which is a side to connect(combine) each piece of image data for the generation of a compositepicture, is recorded as the metadata. The metadata is recorded in, forexample, an exchangeable image file format (Exif). The control unit 116also has a display control unit 116 d, which controls the display of animage on the display unit 104. The imaging apparatus 100 a according tothe present embodiment also has a browser function. The display controlunit 116 d also controls the start of a browser to display a Web page onthe display unit 104. The control unit 116 also has a communicationcontrol unit 116 e, and controls the communication that uses thecommunication unit 114.

The SNS server 200 as an external apparatus of the imaging apparatus 100a includes a database 202, a communication unit 204, and a control unit206. The SNS server 200 has an image server function as well as a socialnetworking service (SNS) server function. Here, previously registeredmembers alone can access the SNS server 200. The registered member isidentified, for example, by the collation of an ID and a password inputby the user with previously registered information.

The database 202 records image files sent to the SNS server 200 from theimaging apparatuses 100 a to 100 d, and a composite picture image filegenerated by image joint processing. The database 202 also records Webpage display data (HTML data).

The communication unit 204 is, for example, a wired LAN interface, andserves as an intermediary when the SNS server 200 communicates with andconnects to the network (e.g., the Internet) 300.

The control unit 206 controls the operation of each block of the SNSserver 200. The control unit 206 includes an image processing unit 206a, and subjects the image data to image processing. The image processingby the image processing unit 206 a is processing (image jointprocessing) for combining multiple image data to generate the compositepicture image file. The control unit 206 also includes a Web pagemanaging unit 206 b, and performs Web page management to, for example,send, to the imaging apparatus 100 a, a Web page corresponding to aninstruction from the imaging apparatus 100 a. The control unit 206 alsoincludes a communication control unit 206 c, which controls thecommunication that uses the communication unit 204.

The operation of the image communication system according to the presentembodiment is described below. First, the operation of the imagingapparatus is described. FIG. 2A, FIG. 2B, FIG. 2C are a flowchartshowing the operation of the imaging apparatus 100 a.

The control unit 116 determines whether an operation mode is a browsermode (step S101). The imaging apparatus 100 a has at least the browsermode, a photography mode, and a reproduction mode as the operationmodes. The operation mode is set in accordance with, for example, theoperation of the operation unit 110 or the touch panel 112 by the user.

When the operation mode is determined to be the browser mode in stepS101, the control unit 116 starts the browser. The control unit 116receives contents from a predetermined sever to display a homepage (stepS102). The following explanation continues on the assumption that theWeb page of a site managed by the SNS server 200 is set as the homepage.It should be appreciated that any homepage can be set by the user. Theuser can also browse Web pages of other sites by inputting URLs orselecting links on the browser. This processing is a known art and itsdetails are therefore not described.

FIG. 3 shows an example of a top screen of the site managed by the SNSserver 200. In the top screen shown in FIG. 3, a list of image filesrecorded in the database 202 is displayed in thumbnails with titles, asindicated by the reference number 401. The user can select a desiredimage and thereby browse the selected image, or give an instruction forthe image joint processing to connect another image to the selectedimage. It is also possible to browse, in this side, a composite pictureimage generated after the image joint processing.

The control unit 116 then determines whether an image has been selectedby the user (step S103). The control unit 116 puts the processing onstandby until determining in step S103 that an image has been selected.

When determining in step S103 that an image has been selected, thecontrol unit 116 requests the SNS server 200 to update the Web page(step S104). The control unit 116 then determines whether thedownloading of the Web page has been completed (step S105). The controlunit 116 waits until determining that the downloading of the Web pagehas been completed. When the downloading of the Web page has not beencompleted within a predetermined time, an error warning may be given.

When determining in step S105 that the downloading of the Web page hasbeen completed, the control unit 116 displays the downloaded Web page(step S106). FIG. 4 is a diagram showing an example of a screendisplayed on the display unit 104 after the selection of the image. Asshown in FIG. 4, when the user has selected an image, a selected image402 is displayed in a magnified form. A title 403 of the image 402 isalso displayed. An image joint button 404 and a return button 405 arealso displayed. The image joint button 404 and the return button 405 aresoftware buttons selectable in the touch panel 112.

After the Web page corresponding to the selected image as in FIG. 4 isdisplayed, the control unit 116 determines whether the image jointbutton 404 has been selected by the user (step S107). When determiningin step S107 that the image joint button 404 has not been selected, thecontrol unit 116 determines whether the return button 405 has beenselected by the user (step S108). When determining in step S108 that thereturn button 405 has not been selected by the user, the control unit116 returns the processing to step S106. In this case, the magnifieddisplay of the selected image is continued. When determining in stepS108 that the return button 405 has not been selected by the user, thecontrol unit 116 returns the processing to step S101.

When determining in step S107 that the image joint button 404 has beenselected, the control unit 116 ends the browser, and switches theoperation mode to a joint photography mode (step S109). The control unit116 then requests the SNS server 200 to send size information for jointphotography and thumbnail image data (connection partner image data), asan instruction to perform the image joint processing (step S110).Although the sending of the thumbnail image is requested here, thesending of the selected image file may be requested. The sizeinformation here is used for the adjustment of image quality duringimage combination. Image quality deterioration may be permitted. Whenimages are not combined into a belt shape, size information for imagecombination with a uniform width may be acquired. Images do not alwaysneed to be combined with the same width. In this case, images differentin width may be arranged to produce such an effect that the images showa rhythmical impression when seen. There may be spaces between images.The spaces may change. In this case as well, size information (e.g., thenumber of pixels constituting the width and height of a side), if any,can be used for further arrangement refinement. Without thisinformation, discretionary image combination is also possible.

The control unit 116 determines whether the receipt of the sizeinformation and the thumbnail image data for the image joint has beencompleted (step S111). The control unit 116 then waits until determiningthat the receipt of the size information and the thumbnail image datahas been completed. Here, the size information is information indicatingthe size of image data that can be uploaded onto the SNS server 200, andis information preset in the SNS server 200. The thumbnail image isthumbnail image data of the image selected in step S103. When thereception has not been completed within the predetermined time, an errorwarning may be given. When the sending of the size information and thethumbnail images has not been permitted in the SNS server 200, an errorwarning may also be given.

When determining in step S111 that the receipt of the size informationand the thumbnail images has been completed, the control unit 116displays the connection side selection guide screen (step S112). FIG. 5is a diagram showing an example of the connection side selection guidescreen. As shown in FIG. 5, a downloaded thumbnail image 406 isdisplayed in the connection side selection guide screen. In this case,four sides of the thumbnail image 406 to be a candidate for a connectionside are, for example, blinking, and the positions of the connectionside candidates are guided to the user. As shown in FIG. 5, a returnbutton 407 is also displayed in the connection side selection guidescreen.

After the display of the connection side selection guide screen, thecontrol unit 116 determines whether a connection side has been selectedby the user (step S113). As shown in FIG. 5, the user slides a finger totrace a side which is to be a connection side among the four sides ofthe thumbnail image 406 displayed on the display unit 104. When such anoperation is detected by the touch panel 112, it is determined that aconnection side has been selected. Here, when a connection side has beenselected, the selected side may be displayed in an enhanced state, forexample, as indicated by the reference number 408. This selection of theconnection side can be further refined as information for the connectionof images. Not only the position of the side to be connected but alsopart of the side may be specified, and a wider image may be connectedalong this side. This can be decided by a slide range in the touchpanel. Images do not need to be strictly connected, and may be connectedwith a particular blank. Such a blank may be selected. The touchedposition may be away to give a blank.

When determining in step S113 that a connection side has not beenselected by the user, the control unit 116 determines whether the returnbutton 407 has been selected by the user (step S114). When determiningin step S114 that the return button 407 has not been selected by theuser, the control unit 116 returns the processing to step S112. In thiscase, the display of the connection side selection guide screen iscontinued. When determining in step S114 that the return button 407 isselected by the user, the control unit 116 returns the processing tostep S101.

When determining in step S114 that a connection side has been selected,the control unit 116 performs a divided through-image display (stepS115). As shown in FIG. 6, the divided through-image display isprocessing to display a divided through-image configured by thecombination of a through-image 409 and the thumbnail image 406. For thisdivided through-image display, the control unit 116 starts the imagingunit 102 to acquire image data for the through-image display. The imageprocessing unit 116 b of the control unit 116 then performs imageprocessing for a general through-image display such as white balancecorrection and gamma correction. After the image processing for thethrough-image display, the image processing unit 116 b generates imagedata for the divided through-image display combined so that data of thethrough-image 409 is located at the position (the position of the rightside in the example of FIG. 5) of the connection side selected in stepS113 in the data of the thumbnail image 406. The image data for thedivided through-image display is preferably rectangular image data. Thethumbnail image 406 and the through-image 409 may not make a rectangularform when arranged side by side depending on the difference of sizetherebetween. In this case, the blank is preferably, for example,“transparent” image data so that the whole image is rectangular. Afterthe generation of the image data for the divided through-image display,the control unit 116 causes the display unit 104 to perform thethrough-image display in accordance with the image data for the dividedthrough-image display obtained by the image processing unit 116 b. Thedivided through-image display shown in FIG. 6 allows the user to have anoverview of the composite picture image generated by the image jointprocessing in the SNS server 200 described later.

Here, the through-image display is designed to display moving images inaccordance with the image data obtained by the repeated operation of theimaging unit 102. Therefore, during the divided through-image display,data of the thumbnail image 406 is combined with the image data of eachframe of the through-image 409.

After the divided through-image display, the control unit 116 determineswhether a resize operation has been performed by the user (step S116).The user can use the touch panel 112 to instruct to resize the thumbnailimage 406 or the through-image 409 which is displayed as the dividedthrough-image as shown in FIG. 6. For example, a pinch operation(operation to spread or narrow the space between fingers) by the user isthe resize operation. When determining in step S116 that the resizeoperation has not been performed by the user, the control unit 116shifts the processing to step S118. The upper limit of the magnificationsize is a size indicated by the size information received in step S111.The size of the image during connection may be changed by such anoperation, or a margin may be provided by a similar operation.

When determining in step S116 that the resize operation has beenperformed by the user, the control unit 116 resizes the thumbnail image406 or the through-image 409. The control unit 116 then uses the imagedata for the divided through-image display after the resizing to updatethe display of the display unit 104 (step S117).

The control unit 116 then determines whether to perform photography(step S118). In step S118, the control unit 116 determines to performphotography when the release button of the operation unit 110 is pressedby the user. When determining in step S118 that photography is notperformed, the control unit 116 returns the processing to step S115. Inthis case, the divided through-image display is repeated. Whendetermining in step S118 that photography is performed, the control unit116 performs still image photography as the joint photography (stepS119).

In this still image photography, the control unit 116 performs AFcontrol to focus the photography lens 102 a, and also performs AEcontrol to decide an exposure condition for the still image photography.The control unit 116 then causes the image pickup device 102 b toperform a photography operation for still image recording in accordancewith the exposure condition decided by the AE control.

After the photography operation for still image recording, the imageprocessing unit 116 b subjects the image data obtained as a result ofthe photography operation in the image pickup device 102 b to generalimage processing for still image recording such as the white balancecorrection, the gamma correction, resize processing, and still imagecompression processing.

After the image processing for still image recording, the control unit116 creates a still image file in accordance with the compressed imagedata, and records the created still image file in the recording unit106. Here, various photography conditions such as a photography date, arecording size of the image data, and an exposure condition are recordedin a header information portion of the still image file as metadata.Moreover, in the present embodiment, information for the identificationof the image data regarding the connection partner (e.g., the file nameof an image file used to generate the thumbnail image 406) andinformation indicating the position of the connection side are alsorecorded as metadata. These metadata are recorded as, for example, taginformation in the form of the Exif. In the present embodiment, athumbnail image is also recorded in an image file.

After the still image photography, the control unit 116 performs acomposite picture confirmation display (step S120). In the compositepicture confirmation display, the control unit 116 generates compositepicture image data which is combined so that the thumbnail image datareceived in step S111 is located at the position of the connection sideof the image data obtained in step S119. The control unit 116 reproducesthe composite picture image data on the display unit 104 as shown inFIG. 7. In the composite picture confirmation display, a comment button410 and a share button 411 are also displayed as shown in FIG. 7. Thecomment button 410 and the share button 411 are software buttonsoperable in the touch panel 112. This composite picture confirmationdisplay allows the user to confirm the composite picture image generatedin the SNS server 200.

In the example described above, the thumbnail images are combined togenerate the composite picture image for confirmation display. Incontrast, the image file selected by the user may be downloaded from theSNS server 200, and image data in the downloaded image file may becombined with image data obtained by photography to generate thecomposite picture image for confirmation display.

After the composite picture confirmation display, the control unit 116determines whether a predetermined time (e.g., about ten seconds) haspassed (step S121). When determining in step S121 that the predeterminedtime has passed, the control unit 116 returns the processing to stepS101.

When determining in step S121 that the predetermined time has notpassed, the control unit 116 determines whether the comment button 410has been selected by the user (step S122). When determining in step S122that the comment button 410 has not been selected, the control unit 116shifts the processing to step S125. When determining in step S122 thatthe comment button 410 has been selected, the control unit 116 displaysa comment input screen. The control unit 116 then records comment datainput by the user in the image file (step S123). The control unit 116then displays a comment 412 input by the user on the display unit 104 toupdate the confirmation display as shown in FIG. 7 (step S124). Thecontrol unit 116 then shifts the processing to step S125.

The control unit 116 then determines whether the share button 411 hasbeen selected by the user (step S125). When determining in step S125that the share button 411 has not been selected, the control unit 116shifts the processing to step S120. When determining in step S125 thatthe share button 411 has been selected, the control unit 116 performsimage sharing processing (step S126). After the image sharingprocessing, the control unit 116 shifts the processing to step S120. Theimage sharing processing is processing in which the image file beingreproduced is sent to a predetermined communication connectiondestination so that this image file can be shared by more than oneperson. The image sharing processing will be described later in detail.

When determining in step S101 that the operation mode is not the browsermode, the control unit 116 determines whether the operation mode is thephotography mode (step S127). When determining in step S127 that theoperation mode is the photography mode, the control unit 116 performscontrol for the general through-image display (step S128). Theprocessing for the through-image display in step S128 is different fromthat in step S115 in that display is only preformed in accordance withthe image data obtained by the image processing for the through-imagedisplay shown in step S115. That is, in step S128, a through-image isdisplayed in the whole screen of the display unit 104, as shown in FIG.8.

After the through-image display, the control unit 116 sets a recordingsize in accordance with the user operation (step S129). To instruct toset the recording size, the user, for example, operates the touch panel112 on a menu screen displayed on the display unit 104. In contrast tothe joint photography mode, the user can set the recording size in thephotography mode.

The control unit 116 then determines whether to perform photography(step S130). In step S130, the control unit 116 determines to performphotography when the release button of the operation unit 110 is pressedby the user. When determining in step S130 that photography is notperformed, the control unit 116 returns the processing to step S128. Inthis case, the through-image display is continued. When determining instep S130 that photography is performed, the control unit 116 performsstill image photography (step S131). The still image photography in stepS131 is basically the same processing as the still image photographydescribed in step S119. However, in contrast to step S119, it is notnecessary in step S131 to record the information for the identificationof the image data regarding the connection partner and the informationindicating the position of the connection side.

After the still image photography, the control unit 116 performs aconfirmation display (step S132). In this confirmation display, thecontrol unit 116 reproduces the image data obtained in step S131 on thedisplay unit 104. In the confirmation display, a comment button and ashare button that are similar to those in the composite imageconfirmation display are also displayed.

After the confirmation display, the control unit 116 determines whethera predetermined time (e.g., about ten seconds) has passed (step S133).When determining in step S133 that the predetermined time has passed,the control unit 116 returns the processing to step S101.

When determining in step S133 that the predetermined time has notpassed, the control unit 116 determines whether the comment button hasbeen selected by the user (step S134). When determining in step S134that the comment button has not been selected, the control unit 116shifts the processing to step S137. When determining in step S134 thatthe comment button has been selected, the control unit 116 displays thecomment input screen. The control unit 116 then records the comment datainput by the user in the image file (step S135). The control unit 116then displays the comment input by the user on the display unit 104 toupdate the confirmation display (step S136). The control unit 116 thenshifts the processing to step S137.

The control unit 116 then determines whether the share button has beenselected by the user (step S137). When determining in step S137 that theshare button has not been selected, the control unit 116 returns theprocessing to step S132. When determining in step S137 that the sharebutton has been selected, the control unit 116 executes the imagesharing processing (step S138). The control unit 116 then returns theprocessing to step S132. The image sharing processing will be describedlater in detail.

When determining in step S101 that the operation mode is not thephotography mode, the control unit 116 determines whether the operationmode is the reproduction mode (step S139). When determining in step S139that the operation mode is not the reproduction mode, the control unit116 returns the processing to step S101.

When determining in step S139 that the operation mode is thereproduction mode, the control unit 116 displays a list of image filesrecorded in the recording unit 106 on the display unit 104 (step S140).The control unit 116 then determines whether the image file has beenselected by the user (step S141). When determining in step S141 that theimage file has not been selected, the control unit 116 returns theprocessing to step S140. In this case, the list display is continued.

When determining in step S139 that the image file has been selected, thecontrol unit 116 reproduces the image file selected by the user (stepS142). In the reproduction processing, the control unit 116 reads theimage file selected by the user from the recording unit 106, and inputsthe read image file into the image processing unit 116 b. The imageprocessing unit 116 b decompresses the input compressed image data. Thecontrol unit 116 inputs the decompressed image data into the displayunit 104 to display the image. Moreover, during the reproduction of theimage file, a comment button 413 and a share button 414 are alsodisplayed as shown in FIG. 9.

After the reproduction of the image file, the control unit 116determines whether the comment button 413 has been selected by the user(step S143). When determining in step S143 that the comment button 413has not been selected, the control unit 116 shifts the processing tostep S146. When determining in step S143 that the comment button 413 hasbeen selected, the control unit 116 displays the comment input screen.The control unit 116 then records the comment data input by the user inthe image file (step S144). The control unit 116 then displays thecomment input by the user on the display unit 104 to update the display(step S145). The control unit 116 then shifts the processing to stepS146.

The control unit 116 then determines whether the share button 414 hasbeen selected by the user (step S146). When determining in step S146that the share button 414 has not been selected, the control unit 116shifts the processing to step S148. When determining in step S146 thatthe share button 414 has been selected, the control unit 116 executesthe image sharing processing (step S147). The control unit 116 thenshifts the processing to step S148. The image sharing processing will bedescribed later in detail.

The control unit 116 then determines whether the end of the reproductionof the image file is instructed (step S148). When determining in stepS148 that the reproduction end of the image file is not instructed, thecontrol unit 116 returns the processing to step S142. In this case, thereproduction of the image file is continued. Moreover, when determiningin step S148 that the reproduction end of the image file is instructed,the control unit 116 returns the processing to step S101.

FIG. 10 is a flowchart showing the image sharing processing. During theimage sharing, the control unit 116 displays such a connectiondestination selection screen as shown in FIG. 11 on the display unit 104(step S201). In the connection destination selection screen of theexample of FIG. 11, as buttons indicating communication connectiondestinations, a device specifying button 415, an SNS button 416 and adisclose button 417 are displayed. The device specifying button 415 isselected by the user when the communication connection destination ofthe imaging apparatus 100 a is a device which can communicate by directcommunication via no network. The SNS button 416 is selected by the userwhen the communication connection destination of the imaging apparatus100 a is the SNS server 200. The disclose button 417 is selected by theuser when the communication connection destination of the imagingapparatus 100 a is a predetermined site which can communicate via thenetwork 300. Furthermore, in the connection destination selection screenof the example of FIG. 11, a return button 418 is also displayed.

After the display of the connection destination selection screen, thecontrol unit 116 determines whether the device specifying button 415 hasbeen selected by the user (step S202). When determining in step S202that the device specifying button 415 has been selected, the controlunit 116 starts the communication unit 114, and detects, from an outputof the communication unit 114, a device as a candidate of thecommunication connection destination communicateable via thecommunication unit 114. The control unit 116 displays a list ofcommunication connection destination candidate device names on thedisplay unit 104 (step S203).

The control unit 116 then determines whether the communicationconnection destination has been selected in accordance with theoperation of the touch panel 112 by the user (step S204). In step S204,the control unit 116 returns the processing to step S203 untildetermining that the communication connection destination has beenselected. When determining in step S204 that the communicationconnection destination has been selected, the control unit 116 performscommunication authentication processing to establish the communicationwith the communication connection destination selected by the user (stepS205). In this case, the control unit 116 urges the user to input an IDand a password, if necessary.

The control unit 116 then determines whether the communicationauthentication is successful (step S206). When determining in step S206that the communication authentication is successful, the control unit116 sends the image file to the communication connection destination viathe communication unit 114 (step S207). The control unit 116 then endsthe processing of FIG. 10. When the control unit 116 determines in stepS206 that the communication authentication fails, for example, in a casewhere the authentication of the password fails, a case where thecommunication cannot be established, or the like, the control unit givesa warning of this failure to the user by the display unit 104 (stepS208). The control unit 116 then ends the processing of FIG. 10.

When determining in step S202 that the device specifying button 415 hasnot been selected, the control unit 116 determines whether the SNSbutton 416 has been selected (step S209). When determining in step S209that the SNS button 416 has been selected, the control unit 116determines whether the present image sharing processing is in the jointphotography mode (step S210). When determining in step S210 that thepresent image sharing processing is in the joint photography mode, thecontrol unit 116 shifts the processing to step S213. The jointphotography mode is a state where an image to be sent after this is tobe connected to another image, and in this case, confirmation processingof step S211 and step S212 is omitted. The confirmation processing ofsteps S211 and S212 is processing for the image file of the imageregarding the connection partner.

When determining in step S210 that the present image sharing processingis not in the joint photography mode, the control unit 116 displays suchan image joint permission selection screen as shown in FIG. 12 on thedisplay unit 104 (step S211). In the image joint permission selectionscreen of the example of FIG. 12, a joint permission button 419 and ajoint non-permission button 420 are displayed.

The control unit 116 then determines whether the permission or thenon-permission of the image joint has been selected in accordance withthe operation of the touch panel 112 by the user, i.e., whether one ofthe joint permission button 419 and the joint non-permission button 420has been selected (step S212). When determining in step S212 that thepermission or the non-permission of the image joint processing has beenselected, the control unit 116 records information of the permission orthe non-permission of the image joint processing in the headerinformation portion of the image file. That is, the control unit 116records information indicating the permission of the image jointprocessing when determining that the joint permission button 419 hasbeen selected, and the control unit 116 records information indicatingthe non-permission of the image joint processing when determining thatthe joint non-permission button 420 has been selected. After recordingthe information of the permission or the non-permission of the imagejoint processing, the control unit 116 performs processing ofcommunication authentication to establish the communication with the SNSserver 200 (step S213). In this case, the control unit 116 urges theuser to input the ID and the password, if necessary.

The control unit 116 then determines whether the communicationauthentication is successful (step S214). When determining in step S214that the communication authentication is successful, the control unit116 sends the image file to the SNS server 200 via the communicationunit 114 (step S215). The control unit 116 then ends the processing ofFIG. 10. When the control unit 116 determines in step S214 that thecommunication authentication fails, for example, in a case where theauthentication of the password fails, a case where the communicationcannot be established, or the like, the control unit gives a warning ofthis failure to the user by the display unit 104 (step S216). Thecontrol unit 116 then ends the processing of FIG. 10.

When determining in step S209 that the SNS button 416 has not beenselected, the control unit 116 determines whether the disclose button417 has been selected (step S217). When determining in step S217 thatthe disclose button 417 has been selected, the control unit 116displays, on the display unit 104, a communication connectiondestination input screen for allowing the user to input information forspecifying the communication connection destination (e.g., a URL of thecommunication connection destination) (step S218).

The control unit 116 then determines whether the communicationconnection destination has been input in accordance with the operationof the touch panel 112 by the user (step S219). In step S219, thecontrol unit 116 returns the processing to step S218 until determiningthat the communication connection destination has been selected. Whendetermining in step S219 that the communication connection destinationhas been input, the control unit 116 performs the communicationauthentication processing to establish the communication with thecommunication connection destination input by the user (step S220). Inthis case, the control unit 116 urges the user to input the ID and thepassword, if necessary.

The control unit 116 then determines whether the communicationauthentication is successful (step S221). When determining in step S221that the communication authentication is successful, the control unit116 sends the image file to the communication connection destination viathe communication unit 114 (step S222). The control unit 116 then endsthe processing of FIG. 10. When the control unit 116 determines in stepS221 that the communication authentication fails, for example, in a casewhere the authentication of the password fails, a case where thecommunication cannot be established, or the like, the control unit givesa warning of this failure to the user, for example, by the display unit104 (step S223). The control unit 116 then ends the processing of FIG.10.

When determining in step S217 that the disclose button 417 has not beenselected, the control unit 116 determines whether the return button 418has been selected (step S224). When determining in step S224 that thereturn button 418 has not been selected, the control unit 116 returnsthe processing to step S201. When determining in step S224 that thereturn button 418 has been selected, the control unit 116 ends theprocessing of FIG. 10.

FIG. 13 is a flowchart showing the operation of the SNS server 200. InFIG. 13, the control unit 206 of the SNS server 200 determines whetherthe image file has been received from the imaging apparatus 100 a viathe communication unit 204 (step S301). When determining in step S301that the image file has been received, the control unit 206 records thereceived image file in the database 202 (step S302).

The control unit 206 then determines whether information for specifyingthe image data of the connection partner (e.g., a file name of anoriginal image file of the thumbnail image 406) and the positioninformation of the connection side are recorded in the headerinformation portion of the image file recorded in step S302 (step S303).When the control unit 206 determines in step S303 that the informationfor specifying the connection partner and the position information ofthe connection side are not recorded in the image file, the control unitreturns the processing to step S301. In this case, the execution of theimage joint is not instructed by the user, and hence only the processingto record the image file is performed.

When determining in step S303 that the information for specifying theconnection partner and the position information of the connection sideare recorded in the image file, the control unit 206 reads, from thedatabase 202, the image file recorded in step S302 (step S304). At thistime, not only the position information of the connection side but alsoinformation of a length or a pixel size may be used. Then, the imageprocessing unit 206 a of the control unit 206 performs combinationprocessing (the image joint processing) to dispose the image datarecorded in the read image file so that the image data is connected tothe position of the connection side of the image data recorded in theimage file of the connection partner recorded in the image file, therebygenerating composite picture image data (step S305). During theabove-mentioned composite picture confirmation display by the imagingapparatus 100 a, thumbnail images are combined with each other, but inthe image joint processing, the original images are combined with eachother. After the image joint processing, the control unit 206 generatesa composite picture image file based on this composite picture imagedata, and records the generated composite picture image file in thedatabase 202 (step S306). The control unit 206 then returns theprocessing to step S301.

In the image combination, images having the same width do notnecessarily need to be combined. Images having different widths may bearranged to produce such an effect that the images show a rhythmicalimpression when seen. There may be spaces between images. The spaces maybe changed. Nevertheless, it is necessary to comprehend that a specifiedimage responds and connects to another specified image.

Moreover, the same image may be connected to a plurality of images.Therefore, only connection information is beforehand held, and actually,it may be contrived that different images can be switched and displayedin accordance with conditions for seeing the images.

In this way, a plurality of users can prepare one composite picture. Thefunction of the present embodiment may be incorporated in a camera. Inthe camera, there is a restriction on an image size as compared with animage size which can be handled on a cloud. Therefore, every time thecomposite picture can be prepared, the composite picture may be resizedto a suitable size (e.g., a pixel number suitable for printing). In thiscase, the image to be subjected to a joint operation may be resized inaccordance with a size of an image which is an object of the jointoperation. Needless to say, the respective images may be held inseparate files, and only when the images are displayed, the images maybe suitably resized to a size suitable for the display, combined anddisplayed.

When determining in step S301 that the image file has not been received,the control unit 206 determines whether update of a Web page isrequested, for example, from the imaging apparatus 100 a (step S307).When determining in step S307 that the update of the Web page isrequested, the control unit 206 sends Web page data to a device whichmakes the request, via the communication unit 204 (step S308). Accordingto such processing, the images and composite picture images recorded inthe database 202 of the SNS server 200 can be browsed, for example, inthe imaging apparatus 100 a. There is the possibility that thiscomposite picture becomes a long and large band-like image when thenumber of users who perform the joint increases. In this case, there isthe possibility that the composite picture overflows from the page, andhence, it may be intended that by the determination of a user operation,the image is displayed so that pages are turned over, or is displayed ina transition display manner as a moving image.

The control unit 206 then determines whether sending of size informationand the thumbnail image is requested, for example, from the imagingapparatus 100 a (step S309). When determining in step S309 that thesending of the size information and the thumbnail image is notrequested, the control unit 206 returns the processing to step S301.When determining in step S309 that the sending of the size informationand the thumbnail image is requested, the control unit 206 determineswhether the image joint processing of the requested thumbnail image tothe original image file has been permitted, i.e., whether theinformation regarding the permission of the image joint is recorded inthe header information portion of this image file (step S310). Whendetermining in step S310 that the image joint processing has not beenpermitted, the control unit 206 returns the processing to step S301. Itis to be noted that in this case, a warning may be given to indicatethat the image joint processing has not been permitted.

When determining in step S310 that the image joint processing has beenpermitted, the control unit 206 sends the size information and thethumbnail image via the communication unit 204 (step S311). The controlunit 206 then returns the processing to step S301.

When determining in step S307 that the update of the Web page is notrequested, the control unit 206 determines whether the comment has beeninput by the user (step S312). When determining in step S312 that thecomment has not been input, the control unit 206 returns the processingto step S301. When determining in step S312 that the comment has beeninput, the control unit 206 records data of the input comment in thecorresponding image file (step S313). The control unit 206 then returnsthe processing to step S301. Here, the comment data may be recorded in afile separate from the image file.

As described above, according to the present embodiment, the user of theimaging apparatus 100 a can select a given side of an image uploadedonto a site managed by the SNS server 200, and connect an imagephotographed by the user to this selected side to prepare a compositepicture. In this way, according to the present embodiment, the user canprepare a composite picture by a simple operation.

Moreover, as shown in FIG. 14A, the user of the imaging apparatus 100 bwho browses the composite picture prepared by the user of the imagingapparatus 100 a can perform the image joint processing similarly to theuser of the imaging apparatus 100 a. When the user of the imagingapparatus 100 b selects the image joint button 404 in a browser screenshown in FIG. 14A, such a connection side selection screen as shown inFIG. 14B is displayed. Then, when the connection side is selected, suchdivided through-image display as shown in FIG. 14C is performed. Here,the example of FIG. 14C shows an example where a lower side of thethumbnail image 406 is selected as a connection side. The example ofFIG. 14C is an example where an already prepared composite picture imageis to be connected to another image. The thumbnail image 406 in thiscase is a thumbnail image of the composite picture image prepared bycombining two images. When the execution of photography is instructed bythe user of the imaging apparatus 100 b after the divided through-imagedisplay, such composite picture confirmation display as shown in FIG.14D is performed. Afterward, composite picture image data is generatedin the SNS server 200.

The above-mentioned processing is repeated among a plurality of users,whereby a composite picture image such as a picture scroll is prepared.In this composite picture image, intentions of the plurality of usersare reflected, and hence it can be considered that the image does noteasily become a monotonous image.

Moreover, in the present embodiment, the image data to be sent to theimaging apparatus 100 a during the image joint processing is thethumbnail image data. The actual image file is not sent, so that theimage uploaded onto the SNS server 200 cannot be shared by any user whodoes not intend to share the image.

Here, in the above-mentioned embodiment, the image data for generatingthe composite picture image data is acquired by the imaging apparatus100 a, and the actual composite picture image data is generated by theSNS server 200. In contrast, the imaging apparatus 100 a may be providedwith functions similar to those of the control unit 206 and the imageprocessing unit 206 a of the SNS server 200, so that the imagingapparatus 100 a may perform processing up to the generation of thecomposite picture image data. Moreover, when the imaging apparatus 100 aperforms the processing up to the generation of the composite pictureimage data, the composite picture image may be generated based on imagedata acquired by communication of the imaging apparatus 100 a withanother imaging apparatus as an external apparatus of the imagingapparatus 100 a. The composite picture image file does not have to berecorded in the server 200. The composite picture confirmation displayhas only to be performed.

Furthermore, in the present embodiment, an example of the selecting unitis the touch panel 112, but various operating units other than the touchpanel 112 can be used as the selecting unit as long as the connectionside can be specified.

Additional advantages and modifications will readily occur to thoseskilled in the art. Therefore, the invention in its broader aspects isnot limited to the specific details and representative embodiments shownand described herein. Accordingly, various modifications may be madewithout departing from the spirit or scope of the general inventiveconcept as defined by the appended claims and their equivalents.

What is claimed is:
 1. An imaging apparatus comprising: a communicationunit configured to acquire image data of a connection partner from anexternal apparatus of the imaging apparatus; a display unit configuredto display an image in accordance with the acquired image data of theconnection partner; a selecting unit configured to select, as aconnection side, one of sides of the image displayed on the displayunit; an imaging unit configured to image a subject to acquire imagedata to be connected to the image data of the connection partner afterthe connection side is selected by the selecting unit; and a controlunit configured to record the image data acquired by the imaging unit ina recording unit together with information indicating the position ofthe connection side.
 2. The imaging apparatus according to claim 1,wherein the communication unit sends the image data recorded in therecording unit and the information indicating the position of theconnection side to the external apparatus in which the image data of theconnection partner is recorded, and the image data sent to the externalapparatus is combined to be connected to the position of the connectionside of the image data regarding the connection partner, to generate acomposite picture image.
 3. The imaging apparatus according to claim 1,further comprising: an image processing unit configured to perform imagecombination so that the image data acquired in the imaging unit isconnected to the position of the connection side of the image dataregarding the connection partner, to generate the composite pictureimage.
 4. The imaging apparatus according to claim 1, wherein thedisplay unit divides and displays the image based on the image data ofthe connection partner and a through-image based on image data forthrough-image display which is acquired by repeatedly operating theimaging unit.
 5. The imaging apparatus according to claim 1, wherein theimage data of the connection partner which is acquired in thecommunication unit is thumbnail image data.
 6. An image communicationmethod comprising: acquiring image data of a connection partner from anexternal apparatus of an imaging apparatus; displaying an image on adisplay unit in accordance with the acquired image data of theconnection partner; selecting one of sides of the image displayed on thedisplay unit, as a connection side, by a selecting unit; imaging asubject after the connection side is selected, to acquire image data tobe connected to the image data of the connection partner.